Papers with UID hypothesis
Expectation and Locality Effects in the Prediction of Disfluent Fillers and Repairs in English Speech (N19-3)
Copied to clipboard
| Challenge: | a study aims to understand the role of disfluencies in speech production . speakers tend to lessen cognitive load for upcoming difficulties . |
| Approach: | They examine the role of three influential theories of language processing in predicting disfluencies in speech production. |
| Outcome: | The proposed classifiers predict disfluencies in English conversational speech . the classifier features lexical surprisal, word duration and DLT integration costs . |
Revisiting the Uniform Information Density Hypothesis (2021.emnlp-main)
Copied to clipboard
| Challenge: | The uniform information density hypothesis posits a preference among language users for utterances structured such that information is distributed uniformly across a signal. |
| Approach: | They propose to test the hypothesis by using reading time and acceptability data to examine the effect of surprisal on language comprehension and acceptabilities. |
| Outcome: | The proposed hypothesis makes predictions about language comprehension and linguistic acceptability . |
A Cognitive Regularizer for Language Modeling (2021.acl-long)
Copied to clipboard
| Challenge: | a uniform information density hypothesis is used to explain certain linguistic phenomena . a regularizer that encodes the UID hypothesis can be used for language training . |
| Approach: | They propose to augment the canonical MLE objective with a regularizer that encodes UID . they find that regularization consistently improves perplexity in language models . |
| Outcome: | The proposed hypothesis can be operationalized as an inductive bias for language modeling. |